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ABSTRACT 

This paper presents the latest in a series of studies 
examining school district report cards. The purpose was to study the 
r elat i onships among factors reported on school district report cards 
from Nevada high schools. The 44 categories reported on Nevada’s 
1993“94 report card represent the study's independent variables, 
grouped into the areas of demographics, teachers, students, and 
expenditures. The 23 high school outcome variables for ninth and 
twelfth grades represent the study’s dependent variables. Analyses 
indicated that most of the state's report card categories have no 
relationship to student outcomes. Report cards and the reported 
analyses o^ entries should be simple, straight-forward, and easy to 
understand. The portrait of the impact of the educational process on 
graduating seniors in Nevada is incomplete, and missing or redundant 
data can produce misleading findings. The study suggests that the 
value of advanced degrees and teacher licenses may be less than it 
has been purported to be and that teacher experience is misunderstood 
and overrated. Parental involvement at the high school level, as 
reported in Nevada, is minimally linked to academic achievement. It 
is possible to glean important information from school district 
report cards, but the current cards probably report too much data to 
be meaningful . Eleven appendixes present statistical associations 
among variables. (Contains 2 figures, 6 tables, and 15 references.) 
(SLD) 
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AN ANALYSIS OF NEVADA’S REPORT CARDS ON HIGH SCHOOLS 



I. INTRODUCTION 

The development of report cards (RC) on schools has become common in a number of states. 
Currently, there is great interest in accountability based on student performance. However, little attention 
has been given to the value and uses of “report card” data. Generally, a reader does not know what 
relationship the entries have to each other or to student achievement, which is considered the “bottom 
line.” The inclusions tend to imply that the factors reported strongly influence student achievement but 
that re'.cionship is not directly stated or explored. What can parents, educators, or policy makers learn 
from examining these state RCs? Nevada's state report cards on high schools are an exception to most 
other state report cards, for their report cards partially analyzed and described the associations between 
report card categories and student outcome. Few other states have undertaken such analyses. 

The purpose of this research was to study the relationships among factors reported on one set of 
report cards — those developed for high schools within Nevada. The analysis offers information about 
how the selected factors relate to student outcomes. Results should interest policy makers and 
educators as they attempt to determine where and how to allocate resources (money, personnel, etc.), 
as they consider report cards. 



II. BACKGROUND 

This paper represents the latest in a series of studies examining school district report cards. The 
investigations of 1988-89 Tennessee report card data explored the relationships among eight school 
district variables (average attendance, average professional salaries, county per capita income, 
expenditure per student, average daily membership, percentage of oversized classes, percentage of 
students on free or reduced lunches, and percentage of educators on upper Career Ladder levels II and 
Ilf) and the relationship between each variable and average student test scores at the school district 
level. In 1990-91 . Tennessee began use of its new Tennessee Comprehensive Assessment Program 
(TCAP), thereby creating a new set of student outcome measures. The authors examined the 
relationships among 1 5 school district variables ( number of schools, average daily membership, percent 
student attendance, percent enrollment change, percent oversized class, percent students on free or 
reduced lunch, expenditure per pupil, county per capita income, percent career ladder, average 
professional salary, percent receiving regular high school diploma, percent receiving honors diploma, 
percent vocational education, percent special education, and percent chapter 1) and the relationship 
between each variable and average student test scores at the school district. In addition, the 1990-91 
and subsequent report cards report TCAP results at substantially more grade levels within school districts 
(2-8, 1 0) making possible the study of relationships among school district characteristics and student 
outcomes at both school levels (elementary, middle, secondary) and individual grade levels (2nd, 3rd, 

4th, etc.). This data analysis made possible interesting extensions of the 1988-89 report card studies 
and made possible a comparison of certain findings in the two sets of studies. 
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The 1992-93 Arkansas school district report cards are similar to Tennessee’s school report cards 
for they both used and reported a norm-referenced national achievement test, and a criterion-referenced 
state-designed achievement test. The authors evaluated the Arkansas's 1992-93 school district data by 
examining the relationships among 1 7 demographic items (Attendance Rate, Completion Rate, Retention 
Rate, Black Student % /Black Staff %, Board/Superintendent/Principal’s Expense, Athletic Expense, 
ADM/Size , Resource Rate, Education Level, Income Level, Free Lunch Rate, Square Miles, Millage, 
Certified Staff ) with six outcome indicators (SAT8 25th Percentile, SAT8 50th Percentile, SAT8 75th 
Percentile, Average ACT, MPT 8th Grade Pass, MPT Student Pass Rate). 

From 1993-95, the authors (French, Bobbett, 1993, 1994, and 1995) have been involved in 
several parallel studies investigating the categories and outcome indicators reported in numerous states 
in different regions of The United States. The authors examined the state report cards in 1 1 
Southeastern (1993), 10 Northeastern (1994), and 8 Western (1995-96) states. These studies compared 
five general areas including: (1) instruments used to measure student outcome, (2) student outcomes 
reported and the procedures for reporting them, (3) levels of outcome data reported, i.e., district, school, 
grade level, classroom, (4) school and community factors reported, and (5) statistical procedures used in 
evaluating the data. 



III. NEVADA SCHOOL DISTRICT REPORT CARDS 

The Executive Summary of Nevada's "Analysis of Nevada School Accountability System (Based 
on NRS 385.347) Submitted to Nevada State Legislature" states: 

During the 1993 session, the Nevada State Legislature enacted into law Nevada 
Revised Statute 385.347, commonly known as the Nevada School Accountability Law. Ji 
requires ail school districts in Nevada to inform the public on the performance of public 
schools throughout the state. School accountability was accomplished throughout the 
state. School accountability was accomplished through a system of reports described in 
the present analysis. School district reports provided information about each school in 
the district to media sources and other interested groups or Individuals. 

Comprehensive accountability reports for 332 schools and all 17 school districts 
for the 1992-93 school year were provided by the school districts in a timely fashion. The 
quality of the reports from each district was regarded as high, and the bulk of the data 
requested in the handbook appeared in the reports generated bv each district 

Statistical analysis reported here investigated relationships between various 
school characteristics and statewide testing of student achievement . It should be noted 
that many of the findings that could be uncovered in analyzing individual student data 
may be obscured since the present analyses compare information aggregated at the 
school-level. Although further analyses are recommended in later accountability reports, 
the present school-level analyses suggest that particular effectiveness of: 

• in-school programs and school-readiness preschool programs that target low 
socioeconomic children and children with English as a second language; 

• programs to improve student attendance rates; 
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programs to encourage parental attendance at school coherences and 
involvement in their children’s education; 



programs to encourage teachers to continue their own academic achievement : 
and 

programs that encourage student involvement in gifted/talented and advanced 
placement programs. 



The accountability reports to the public must contain intormation concerning: 



• educational goals and objectives; 

• comparisons ot student achievement for the current school year with previous 
school years; 

• ratios of students to teachers and other data concernin g licensed and unlicensed 
employees of the school district; 

• comparisons of teacher assignments with the qualifications and licensure of 
teachers; 

expenditures per pupil, set forth individually for each source of funding; 

• curriculum employed by the school district, including any special programs for 
students at an individual school; 

• records of attendance and advancement of students and graduation rates in 
each high school; 

• other information as directed by the State Superintendent of Public Instruction. 

Nevada's Analysis of Nevada School Accountability System Submitted to Nevada State 
Legislature secondary school analyses section stated: 

... the increased number of secondary schools and the reduced influence of 
homogeneous socioeconomic and cultural factors on averaged school data should create 
difficulties in finding reliable relationships between school characteristics and 
achievement performance. . . . Further, at the secondary school-level, regression 
analyses were conducted that are not reviewed in this report since the analyses failed to 
profile significant information . 

... the directions of partial correlations are listed in parentheses for certain 
school characteristics that slightly missed reaching a statistically significant level (p<.05, 
but <.10), but only if they were related to other student achievement data in the other 
analyses in that section (e.g., the other writing traits on a grade-level Stateside Writing 
Examination). 

In the Reading section of grade 9 CTBS/4, performance increased with increases 
in the schools’ attendance rates and increases in the percentage of students in advanced 
placement and gifted/talented programs. Reading performance decreased with increases 
in the percentage of students in English as a Second Language programs and increases 
in the percentage of teachers with baccalaureate degree only in schools. 
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Few reliable findings emerged for the Mathematics section of grade 9 CTBS/4. 
Performance increased with increases in the percentage of students whose parents 
attended the schools' firs t parent/teacher conferences and increases in the percentage of 
students in advanced placement programs. 

The Implications sections overviewed the relationships between the report card 
categories and the variety of outcome indicators. An example from the Implications section 
follows: 



The "school characteristics" reviewed in the analyses' discussion can be considered as 
falling into types: those that are characteristics primarily of schools and those that reflect 
an Interaction of student/family characteristics and school characteristics. The 
findings for the relationship between primarily school characteristics and student 
achievement are mixed in the present school-level analyses. One school-based variable 
that had a positive relationship on grade three students and on reading in grade nine was 
teachers with degrees higher than a baccalaureate. This variable also had a positive 
relationship with on grade nine writing achievement, although the relationship was not 
significant due to the small number of schools compared. To the extent that this variable 
is important to student achievement , schools should encoura ge teachers to continue their 
own educational attainment . Also, teachers who have taught for 10 years and beyond 
appear to be related to improved reading at grade three, but the relationship was 
inconsistent on other achievement results, (emphasis added) 

The 44 categories reported in Nevada's report card represent the study's independent variables. 

These categories are grouped into four areas : demographic, teachers, students, and expenditures. S:*e Figure 
1 (with abbreviations used in this paper). The 23 high school outcome indicators for 9th and 1 2th grades 
represent the study's dependent variables. These outcomes were further segregated into areas according to the 
type of outcome. For instance, outcomes 1 and 2 are grouped into one area representing national percentile 
rankings: outcomes 19 through 23 are grouped into one area representing college admissions tests. See 
Figure 2 (with abbreviations used in this paper). Also, refer to Appendix E for the outcome area groupings. 

IV. METHODOLOGY 

Investigators used the 1993-94 Nevada school district report card data for the study. The 23 
student outcomes were used as the study’s dependent variables, and the 44 categories were uced as 
independent variables. The following research questions guided the study: 

1 . How do school district characteristics currently reported in the report cards relate to the reported 
student achievement? 

2. What report card areas (demographic, teachers, students, and expenditure) have an important 
relationship with different outcome areas? 

3. Which of the 23 outcome indicators are influenced the most by the 44 report card categories? 

4. What report card categories have an important relationship with each of the 23 outcome 
indicators? 

5. After removing the eight categories having redundant or missing data, what report card areas 
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& DEMOGRAPHIC 

1 % Enrollment. (%EN) 

2 % Enrollment Change. (%ECH) 

3 % Transiency rate. (%TR) 

4 % Attendance. (%AT) 

5 % Dropout rate. (%DR) 

6 Number of students per counselor. (NCS) 

6 IEACHEBS 

7 % Teacher with BA's. (%TBA) 

8 % Teachers with MA’s. (%TMA) 

9 % Teachers with PHD's. (%TPHD) 

1 0 % New teachers. (%TNE) 

1 1 % Teachers with 1 -3 yrs experience. (%T 1 -3) 

12 % Teachers with 4-6 yrs experience. (%T4-6) 

1 3 % Teachers with 7-9 yrs experience. (%T7-9) 

14 % T eachers with 1 0 yrs experience . (%T 1 0) 

1 5 Oversize class in English. (NENG) 

1 6 Oversize class in Math. (NMAT) 

1 7 Oversize class in Science. (NSC) 

1 8 Oversize cla ss in Social science. (NSS) 

19 % of English classes taught by teachers 
outside the r area License /Endorsement. 
(%ENLIC) 

20 % Math classes taught by teachers outside 
their area License/Endorsement. (%MALIC) 

21 % Science classes taught by teachers outside 
their area License/Endorsement. (%SCLIC) 

22 % Social science classes taught by teachers 
outside their area License/Endorsement. 
(%SOLIC) 

23 % Occupational education classes taught by 
teachers outside their area License and 
Endorsement. (%OCLlC) 

& STUDENTS 

24 % of students receiving special education 
services. (%SP) 



% of students receiving English as a Second 
Language Service. (%ESL) 

% of students receiving migrant education. 
(%MIG) 

% of students receiving gifted and talented 
programs. (%GIF) 

% of students receiving free lunch. (%FRL) 

% of student receiving music education. 
(%MUS) 

% of student receiving art education. (%ART) 

% of students participating in occupational 
education. (%OC) 

% of students participating in foreign 
language. (%FL) 

% of students participating in advanced 
placement programs. (%APPER) 

% of students participating in athletics. 
(%ATH) 

% of students whose parents attended the first 
parent/teacher conference. (%PTC) 

EXPENDITURES 

the school’s per pupil expenditure for 
Instruction. ($INST) 

the school's per pupil expenditure for 
administration. ($ADMIN) 
the school's per pupil expenditure for building 
operation. ($BLDG) 

the school's per pupil expenditure for staff 
support.($SFSO) 

the school's per pupil expenditure for student 
support. ($STSP) 

% of expenditures provided by local. (%LOC) 

% of expenditures provided by state. (%ST) 

% of expenditures provided by federal. (%FED) 
of expenditures provided by opening balance 
sources. (%$OPE) 



25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 
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36 

37 

38 
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41 
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Figure 1. 



Nevada's 44 high school report card categories. 



9th Grade 



12th Grade 



1 - the national percentile rank of the school's 
average score on the standardized 
Comprehensive Test of Basic Skills of r grade 
nine in reading. (O: RKRE) 

2 - the national percentile rank of the school's 
average score on the standardized 
Comprehensive Test of Basic Skills of r grade 
nine in math. (O: RKM A) 

3 - increase or decrease (negative numbers) in 
the national percentile rank of the average 
score on the CTBS for the school at grade 
nine in reading. (O: RECT) 

4 - increase or decrease (negative numbers) in 
the national percentile rank of the average 
score on the CTBS for the school at grade 
nine in math. (O: MACT) 

5 - the percentage of ninth grade students in a 
school that score in the bottom 25 percent 
(national) of scores on the CTBS in the area 
of reading. (O: REBQ) 

6 - the percentage of ninth grade students in a 
school that score in the top 25 percent 
(national) of scores on the CTBS in the area 
of reading. (O: RETQ) 

7 - the percentage of ninth grade students in a 
school that score in the bottom 25 percent 
(national) of scores on the CTBS in the area 
of math. (O: MABQ) 

8 - the percentage of ninth grade students in a 
school that scored in the top 25 percent 
(national) of scores on the CTBS in the area 
of math. (O: MATQ) 

9 - the percent of ninth grade students proficient 
in "ideas”. (0: 91D) 

10 - the percent of ninth grade students proficient 
in ’’organization”. (0: 90R) 

11 - the percent of ninth grade students proficient 
in ’Voice". (0: 9 VO) 

12 - the percent of ninth grade students proficient 
in ’’conventions". (0:9C0) 



13 -the percentage of graduating class passing 
the reading sections of the Nevada High 
School Proficiency exam. (O: %REPR) 

14 - the percentage of graduating class passing 
the writing sections of the Nevada High 
School Proficiency exam. (O: %WRPR) 

15 - the percentage of graduating class passing 
the mathematics sections of the Nevada 
High School Proficiency exam. (O: %MAPR) 

1 6 - change (increase or decrease) from the 
previous year in the percei.. u ge of a school's 
graduating class passing the reading 
sections of the High School Proficiency exam. 
(O: IDRE) 

1 7 - change (increase or decrease) from the 
previous year in the percentage of a school's 
graduating class passing the mathematics 
sections of the High School Proficiency exam. 
(O: I DMA) 

1 8 - change (increase or decrease) from the 
previous year in the percentage of a school's 
graduating class passing the writing sections 
of the High School Proficiency exam. (O: 
IDWR) 

1 9 - percentage of graduating class taking the 
college ACT exam. (O: %GACT) 

20 - percentage of graduating class taking the 
college SAT exam. (O: %GSAT) 

21 - the average scores obtained on the ACT 
Composite. (O: AACT) 

22 - the average scores obtained on the SAT 
Math section. (O: ASATM) 

23 - the average scores obtained on the SAT 
Verbal section. (O: ASATV) 



Figure 2. Nevada's 23 high school report card outcome indicators. 
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(demographic, teachers, students, and expenditure) have an important relationship with different 
outcome indicators ? 

6. After removing the eight categories having redundant or missing data, which of the remaining 36 
report card categories have the largest and smallest percent of association with the outcome 
indicators? 

7. After removing the 8 categories having redundant or missing data, what report card categories 
have an important relationship with each of the 23 outcome indicators? 

8. Are there differences in the categories' relationships with 9th grade and 12th grade outcomes? 

9. What categories have the most association with student outcomes? 

Investigators treated student outcome data (test data) as the dependent variable and other 
characteristics reported as independent variables that influence student outcomes. Several analyses were 
conducted. 

To answer research question #1 , a Pearson Product Moment correlation was developed as a means of 
comparing report card categories to each 9th and 1 2th grade outcome indicators. 

For question #2, the Stepwise Regression (SWR) statistic was used to identify category areas 
(demographic, teacher, student, expenditure) with a significant association to outcome areas . This 
multivariate model was used for two reasons: there was a small number of high schools used in the 
study (i.e., 45), and variances for many of the categories might have an unusually large impact on the 
analysis. 

To answer question #3, no further analysis was needed. The SWR statistic was used to identify 
categories areas with a significant association with each of the 9th and 12th outcome indicator areas. 

To respond to question #4, no further analysis was needed. The SWR statistic was used to 
examine the number of important associations among the 44 report card categories and the 9th grade 
outcome, 1 2th grade outcome, and the sum total assocations. 

Before question #5 was answered, the raw data for each category were re-examined. Because 
some categories reflected a large number of zeros, eight report card categories were eliminated from 
further study. The Exploratory Mixed Stepwise (EMS) regression model was used to examine the 
relationships between the report card areas and the outcome areas. 

For question #6, the EMS regression was used to examine the percent of variance between each 
of the 23 outcome indicators and the 36 remaining report card categories. 

In response to question #7, the categories with an important association with each of the 23 
outcome indicators were identified. 

No further analysis was need to answer question #8. The EMS analysis was used to compare 
categories that had as significant association with the 9th grader outcomes and 12th grade outcomes. 

To respond to question #9, both the SWR and the EMS regression models were used to 
examine collectively the aggregate association for the 36 remaining categories on each of the 9th grade 
outcomes, 12th grade outcomes, and the total assocations. 
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V. FINDINGS 

The study's findings are reported in two areas: (A) descriptive analyses of high schools, and (B) 
responses to the research questions. 

A. Descriptive Analyses of High Schools 

1 . Category Data Nevada's 44 high school categories were organized into four areas: general 

demographics, teachers, students, and expenditures. 

a. General demographics. The average high school's enrollment (%EN) was 1 160 students. 

The largest high school had 2,952 students and the smallest high school had 70 students. The standard 
deviation (SD) analysis suggested two £Qs between the largest and smallest high school. The average 
high school’s percent enrollment change (%ECH) was +5.7%. The three SDs between the largest 
(49.9%) and smallest (- 25.4%) %ECH suggested that Nevada's HS enrollment change varied greatly. 

The transiency rate averaged about 26% and ranged from 0% to 57%. The percent student attendance 
(%AT) for the top HS was three SDs above the mean and for the bottom school district, three SDs below the 
mean. The range of attendance was 85% to 98%. The average HS reflected a 6.4% dropout rate (%DR) that 

ranged from 0%to 44.4%. The average HS reflected about 351 students per counselor that ranged from 138 
students per counselor to 544 students per counselor. 

b. Teachers. Seventeen of Nevada's 44 categories reflected teacher related activities. About 53% 
of the teachers had earned a BA degree, 46% had received a MA degree, and a very few had earned a 
PHD (0.7%). The percent BA's ranged from 19% to 100%, the percent MA's ranged from 0% to 81%, 
and the percent PHD'S ranged from 0% to 10%. The 3 £Ds between the top and bottom percentages for 
the three teacher degree classifications suggested that the teachers reflect a wide degree of 
postsecondary education. About 6% were new teachers, 19% had taught 1-3 years, 12% had taught 4-6 
years, 10% had taught 7-9 years, and 53% had taught 10 or more years— a large percentage were 
experienced teachers. 

About 23% of English, math, science, and social studies were classified as oversized classes. 
Approximately 1% of all classes in English, math, science, social studies, and occupational education were 
taught by teachers outside their area of License/Endorsement . The 3 plus SDs above the mean suggested 
that some HSs strongly rely on a large percentage of teachers teaching outside their area, especially in English 
and math. 

c. Students. Nevada report cards had 12 categories describing the HS student's academic profile. 
Approximately 8% of the students take special education, about 2.2% of the students take English as a 
second language, less than a half percent participate in migrant education, and almost 3% participate 
in gifted and talented classes. Although about 11% of the students qualify for free and reduced lunch, 
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the £12 of 1 1 .7% suggested the high schools with the largest percent (43%) of free and reduced lunch 
were three SD s above the state mean. Art participation averaged about 23% and music education 
about 1 6%. The £Q of 1 1 suggested that the largest participation in art (42%) and music education 
(64%) were 3+ SD s above the state mean — music and the arts are strongly emphasized in some HSs. 

One HS had a 1 00% participation in occupational education. The mean and £12 of about 11% 
suggested that one or more HSs strongly promote occupational education. About 26% of the students 
take a foreign language in HS(range: 0% to a large of 54%) : foreign language is strongly emphasized 
in one or more HSs. Approximately 6% of the students participate in advanced placement programs. 
The ££ of about 7% suggested that the HS with the largest percent of advanced placement programs 
(31%) considers them an essential academic activity. Approximately 44% of the students participate in 
athletics (range: 0% to 92%). About 48% of the parents participate in the first parent-teacher meeting in 
the fall. The £J2 of 24% reflected that the HS with the smallest percent participation (9%) was almost 2 
££s below the state mean, and the HS with the largest percent participation of 100% reflected 2 SDs 
above the state mean. 

d. Expenditure Nine of the 44 categories related to expenditure related issues. The average HS 
spent about $3,1 58 on each student. One HS spent a low of $2,204 per student while another spent a 
high of $6,093 per student— a $3,889 difference. The student expenditure per administrator 
averaged about $402 and ranged from a low of $338 to a high of $2,293 — the largest amount spent was 
about seven times more than the HS that spent the least. Do the community members, board members, 
or parents think that a large administrators salary is directly linked to educational excellence? The typical 
HS spent about $740 for the school's per pupil expenditure for building operation, and ranged from $294 
to $1 ,814 — a $1 ,520 or 600% difference. The typical HS spends about $177 on per pupil expenditure staff 
support (range: $76 to $694). The average school spends about $502 on per pupil expenditure for 
student support. The £Q of $1 29 reflected that one HS’s per pupil expenditure for student support was 
3 ££s below the state mean while the HS that spent the most — $891— was 3 SD s above the mean. Of 
the average HS budget, 51% local contributions, about 41% came from the state, approximately 3% 
was federal money, and 5% came from open balance sources. Local contributions ranged from18% to 
70%, state contributions ranged from 0.3% to 72%, federal contributions ranged from 0.4% to 13%, and 
open balance sources ranged from 1% to 30%. The four expenditure categories' 3-plus ££ for these 
expenditure categories suggested that high school funding sources varied greatly . 

2. Student Outcome Data Nevada reflected 23 high school student outcome indicators: 12 
categories related to 9th grade student outcome, and 1 1 outcome indicators related to 12th grade 
student outcome (Appendix B). Both reading and math outcome indicators were reported from four 
perspectives: percent national ranking, percent increase or decrease in the national percentile rank of 
the average score on the CTBS, bottom 25 percentile, and top 25 percentile. 
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a. Ninth Grade. The average HS's CTBS' reading outcomes reflected a 55.8% national 
percentile ranking, a -0.4% decrease, a 17.5% for the bottom 25 percentile and a 28.1% for the top 25 
percentile. The average HS's CTBS math outcome reflected a 54.7% national ranking, a 0.0% increase, 
a 21 .2% for the bottom 25 percentile and a 30.3% for the top 25 percentile. There were 3 plus SDs 
between the bottom and top outcome scores for the four reading outcomes and the four math outcomes. 
Collectively, the analysis suggested that the reading scores were slightly above the national average but 
reflected a subtle downward trend. The math scores were also slightly above the national average and 
reflected no change. 

About 67% of 9th graders were proficient in ideas, 64% in organization, 79% in voice, and 73% 
in conventions. The three plus SDs (11.2, 12.8, 10.6, and 12.5, respectively) between the lows (22, 20, 

28, and 18, respectively) and highs (85, 82, 100, and 92, respectively) suggested a large disparity 
between the bottom and top schools. 

b. 12th Grade/high school graduate Proficiency. About 97% of the graduating class passed the 
reading and writing sections of the Nevada High School Proficiency (NHSP) exam, and approximately 
98% passed the math exam. Reading reflected a 5.9% 312, writing reflected a 6.4% 3D. and math 
reflected a 6.3% 3D- Although Pahrump HS's reading, writing, and math scores (M=62.9, 57.6, and 
58.3, respectively) were 3 SD s below the state mean, Nevada's other 44 HSs scores were within one 3D 
of the state mean for all three outcome indicators. Reading (+0.2%) and math (+0.3%) scores reflected a 
slight upward trend and the writing (-0.3%) scores refected a slightly downward trend. 

Almost 45% of Nevada's HS graduates took the ACT exam, and about 28% of the graduates 
took tl i SAT exam. Since the ACT exam reflected a 15.6 3D and the SAT exam reflected a 18.4 3D, 
the great majority of schools were within 2 3D of the mean. The ACT composite score averaged 20.8, 
and ranged from 1 7.1 to 23. The 3D of 1 .3 suggested that the top and bottom schools were about 3 SDs 
above and below the state mean. The average SAT math score was 473 and the average SAT verbal 
score was 426. The combined average SAT of 899 is about 100 points higher than the national norm 
[800= a z-score of "0” or at the mean]. This also suggested that Nevada's students taking the SAT 
scored higher in math than reading. 

B. Findings Pertinent to Research Questions 

1 . How do school district characteristics currently reported In the report cards relate to the 

reported student achievement? 

The Pearson Product Moment correlation (univariate analysis) was used to examine the 
relationship between each of the 23 high school outcome indicators and the 44 report card categories. 
The shaded area of Appendix C illustrated that a large number of relationships were not significant 
(p<.05, 1-tail, r=±.288). 
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a. Outcome Indicator Relationships. High school outcome indicators were organized into two 
subgroups. There were twelve 9th grade outcome indicators and eleven 12th grade outcome indicators. 
About 39% of the 9th grade relationships were significantly related to the 44 category variables, and 
about 43% of the 1 2th grade outcome indicators reflected significant associations with the 44 category 
variables. The shaded areas also showed no consistent associations between any of the 44 categories 
and the 23 outcome indicators (examine shaded areas). When the 9th and 12th grade relationships 
were examined collectively, 41% of the possible relationships were significant and 59% of the 
relationships were not. Of the 44 possible relationships per outcome indicators, the following had no 
significant relationships: 



Number of Categories No Slanlfcant Relationships to: 

36 REBQ - the percentage of ninth grade students in a school that score in the 

bottom 25 percent (national) of scores on the CTBS in the area of 
reading. 

35 RKM A - the national percentile rank of the school's average score on the 

standardized Comprehensive Test of Basic Skills of r grade nine in 

math. 

M ACT - increase or decrease (negative numbers) in the national percentile rak 
of the average score on the CTBS for the school at grade nine in 
math. 

IDMA - change (increase or decrease) from the previous year in the percentage 
of a school's graduating class passing the mathematics sections of 
the High School Proficiency exam. 

34 RECT- increase or decrease (negative numbers) in the national percentile rak of 

the average score on the CTBS for the school at grade nine in 
reading. 

IDWR - change (increase or decrease) from the previous year in the percentage 
of a school's graduating class passing the writing sections of the 
High School Proficiency exam. 

1 9 9 VO - the percent of ninth grade students proficient in "voice". 

%GSAT - percentage of graduating class taking the college SAT exam. 

1 8 %GACT - percentage of graduating class taking the college SAT exam. 

1 6 90R - the percent of ninth grade student proficient in "organization". 

9CO - the percent of ninth grade student proficient in "conventions". 

This analysis illustrated two points: (1) a large number of possible relationships are not 
significant, and (2) there was no consistency (either significant relat’onships or no significant 
relationships) between high school outcome indicators and the 44 category variables. 



b. Category Relationships Appendix C illustrated that a large number of categories did not have 
an important association with the 23 outcome indicators. For example: 
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Number of Relationships Caaeaorles with no Impo rtant association 

1 %ECH - percent change in school enrollment from previous year 
%OCUC - percentage of occupational education classes taught by teachers 

outside their area of license/endorcement. 

2 %FL - percentage of students participating in foreign language. 

3 %r T C - percentage of students whose parents attended the first parent/teacher 

conference. 

NCS - number of students per counselor 

4 %SCLI C - percentage of science classes taught by teachers outside their area 

of license/endorsement. 

5 %T1 0 - percentage of teachers with 1 0 years experience. 

Since a large number of categories did not reflect a significant relationship with a majority of 
the 23 outcome indicators, why were they included in the report card format? 

There are a large number of important relationships between some categories and the 23 
outcome indicators. For example, 

Number of Relationships Categories with a large number of association s 

1 8 %DR - the overall dropout rate of the school in a combination of any grades 9- 

12 . 

1 7 %T R - percent transiency rate for school 

1 6 NENG- overal class size in English 

1 5 %EN-School enrollment as of official Fall Count 

%AT - percent attendance rate 
NCS- number of students per counselor 

%APPER- percentage of students participating in advanced placement 
programs. 



c. NO Relationships with Student Outcome. Appendix C illustrated the number of categories 
with significantly negative, significantly positive, and no associations with the 23 student outcome 
indicators. 

Thirty or more categories out of 44 had no significant relationship with any of the 23 student 
outcome measures. The 9th grade analysis suggested that 30 or more categories reflected no important 
association with the following outcome indicators: 

9th Grade 

1 O: RKMA- the national percentile rank of the school's average score on the standardized 

Comprehensive Test of Basic Skills of r grade nine in math. 

2 O: RECT- increase or decrease (negative numbers) in the national percentile rank of the average 

score on the CTBS for the school at grade nine in reading. 

3 O: M ACT - increase or decrease (negative numbers) in the national percentile rank of the average 

score on the CTBS for the school at grade nine in math. 

4 O: REBQ - the percentage of ninth grade students in a school that score in the bottom 25 percent 

(national) of scores on the CTBS in the area of reading. 

5 O: RETQ- the percentage of ninth grade students in a school that score in the lop 25 percent 

(national) of scores on the CTBS in the area of reading. 
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O: MATQ- the percentage of ninth grade students in a school that score in the lop 25 percent 
(national) of scores on the CTBS in the area of math. 

The 12th grade analysis suggested that 30 or more categories reflected no important association 
with the following outcomes: 

12th Grade : 

1 • 0: IDRE- change (increase or decrease) from the previous year in the percentage of a school's 

graduating class passing the reading sections of the High School Frofidency exam. 

2. O: IDMA - change (increase or decrease) from the previous year in the percentage of a school's 

graduating class passing the mathematics sections of the High School Proficiency 
exam. 

3. O: IDWR- change (increase or decrease) from the previous year in the percentage of a school’s 

graduating class passing the writing sections of the High School Proficiency exam. 



d. Positive and Negative associations Appendix D illustrated that eight of the twelve possible 
9th grade outcome indicators had a larger number of categories with positive associations than negative 
associations including: 

1 . O: RKRE- the national percentile rank of the school's average score on the standardized 
Comprehensive Test of Basic Skills of r grade nine in reading. 

2 O: RECT- increase or decrease (negative numbers) in the national percentile rank of the average 

score on the CTBS for the school at grade nine in reading. 

3 O: MACT - increase or decrease (negative numbers) in the national percentile rank of the average 

score on the CTBS for the school at grade nine in math. 

4 O: MABQ - the percentage of ninth grade students in a school that score in the bottom 25 percent 

(national) of scores on the CTBS in the area of math. 

5 O: MATQ- the percentage of ninth grade students in a school that score in the lop 25 percent 

(national) of scores on the CTBS in the area of math. 

6 0: 9ID- the percent of ninth grade student proficient in "Ideas". 

7 0: 90R- the percent of ninth grade student proficient in "organization”. 

8 0: 9C0 - the percent of ninth grade student proficient in "conventions". 



About three of the eleven 12th grade outcome indicators had a larger number of categories with 
positive associations than negative associations including: 

1 . 0: %WRPR- the percentage of graduating class passing the writing sections of the Nevada High 

School Proficiency exam. 

2. O: %GSAT- percentage of graduating class taking the college SAI exam. 

3 . O : AACT- the average scores obtained on the ACT Composite 



Does this suggest that the categories selected for 9th grade were selected from a positive 
perspective (number of positive relationships outweigh the number of negative associations)? In 
contrast, were the 12th grade categories reflecting the high school exit exams (state criterion referenced 
writing exam and both college admissions tests) selected on the basis of negative associations (i.e., 
more categories with a negative association than with a positive association)? 

Two regression models were used in the findings below , including Forward Stepwise 
Regression (SWR), and Exploratory Mixed Stepwise (EMS) regression (Forward and Backward). The 
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authors will discuss the analyses' more important associations (highlights). For greater and clearer 
detail, the reader is urged to explore each regression model. 

2. What report card areas (demographic, teachers, students, and expenditure) have an 
Important relationship with different outcome areas? 

Stepwise Regression (Forward) was used to examine the relationships between the report card 
areas and the student outcome areas. The large shaded boxes in Appendix E illustrate that no important 
associations exist between an outcome area and a category area. Table 1 also shows the category 
areas and outcome areas having no significant relationships with each other. 

Note that in some of the boxes in Appendix E, only one significant relationship exists (indicated 
by a checkmark). For example, there is only one significant relationship when comparing the 6 
demographic items with the 2 CTBS reading and math ranking outcome items (6x2 = 12 possible 
relationships). It is difficult to argue that a relationship exists between demographic items and CTBS 
reading and math rankings when only 1 of a possible 12 relationships in the box (or 8%) are significant. 

3. Which of the 23 outcome indicators are Influenced the most by the 44 report card 
categories? 

Forward Stepwise Regression was used to calculate the percent of variance for each of the 23 
outcome indicators by the 44 category variables. Table 2 and Appendix E suggested that the 44 
categories account for an average of 76% (i.e., Adjusted r*2) of the variance of the outcome indicators. 
The percent of variance for the 23 outcome indicators ranged from 52% to 93%. However, the significant 
associations do not suggest any clear or consistent trends between different category areas and 
outcome areas, but are sparsely scattered in an apparently random manner. 

4. What report card categories have an Important relationship with each of the 23 outcome 
indicators? 

Forward stepwise regression was used to examine the number of important associations among 
the 44 report card categories and the 23 outcome indicators. Totals for each category were sorted in 
descending order — see Appendix F. Table 3 illustrates the six categories with the largest number of 
associations to the 23 outcome indicators. 

While 6 of the 44 report card categories reflected five or more important associations, 38 
categories reflected four or less significant relationships with academic achievement. Also, many 
categories reflected both positive and negative relationships with student outcome. 

Any significant relationship between the independent and dependent variables using one 

STATISTICAL TECHNIQUE SHOULD BE RE-CHECKED BY USING A SECOND STATISTICAL PROCEDURE. To CONFIRM THE 

earlier Stepwise regression analysis, the authors attempted to use exploratory multiple regression 

TO RE-EXAMINE THE RELATIONSHIPS BETWEEN REPORT CARD CATEGORIES AND THE 23 OUTCOME INDICATORS. THE 
AUTHORS OBSERVED THAT MANY OF THE CATEGORIES CONTAINED MISSING DATA, OR REFLECTED A LARGE 
PERCENTAGE OF DATA REFLECTING ZEROS. APPENDIX G ILLUSTRATES THAT EIGHT OF THE 44 REPORT CARD 
CATEGORIES REFLECTED A DISPROPORTIONATELY LARGE NUMBER OF ZEROS, RANGING FROM 16 TO 42. COULD 
MISSING DATA OR A LACK OF VARIANCE (ZEROS) HAVE AN IMPACT ON THE REGRESSION MODEL? SINCE THE 
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Category areas reflecting no association with the different outcome areas (refer to 
Appendix E) . 



Category 



Area 




Grade 


Demographic 


VS 


12th 


Teacher’s 


Degrees 


vs 


9th 




vs 


9th 




vs 


12th 




vs 


12th 


Experience 


vs 


9th 




vs 


9th 




vs 


12th 




vs 


12th 


Oversize classes 


vs 


9th 




vs 


9th 




vs 


9th 




vs 


12th 




vs 


12th 


Licenses/endors. 


vs 


9th 




vs 


12th 


Expenditures 


Demographics 


vs 


9th 




vs 


12th 




vs 


12th 


Source 


vs 


9th 




vs 


9th 




vs 


9th 




vs 


12th 




vs 


12th 



Outcome Area 

-NHSPE (reading, math, and writing) scores. 



-CTBS national ranking (reading and math) 

-top / bottom 25 % CTBS (reading and math) 
scores 

-NHSPE (reading, math, and writing) scores 
-increase/decrease NHSPE (reading, math, and 
writing) scores 

-CTBS national ranking (reading and math) 

-top / bottom 25 % CTBS (reading and math) 
scores 

-NHSPE (reading, math, and writing) scores 
-increase/decrease NHSPE (reading, math, and 
writing) scores 

-CTBS national ranking (reading and math) 
-increase/decrease CTBS (reading and math) 
-top / bottom 25 % CTBS (reading and math) 
scores 

-NHSPE (reading, math, and writing) scores 
-college admissions tests (e.g., ACT, SAT, etc.) 



-Nevada criterion-referenced (ideas, 
organization, voice, and conversation) 
-increase/decrease NHSPE (reading, math, and 
writing) scores 



-CTBS national ranking (reading and math) 
-increase/decrease NHSPE (reading, math, and 
writing) scores 

-college admissions tests (e.g., ACT, SAT, etc.) 

-increase/decrease CTBS (reading and math) 
scores 

-top / bottom 25 % CTBS reading scores 
-top / bottom 25 % CTBS math scores 
-increase/decrease NHSPE (reading, math, and 
writing) scores 

-college admissions tests (e.g., ACT, SAT, etc.) 



Table 2. 



Grade 

9 

12 

9 

12 

12 

9 

9 

9 

9 

12 

9 

9 

12 

9 

12 

9 

12 

12 

9 

9 

12 

12 

12 



The percent of variance (in descending order) for each outcome indicator as explained 
by the 44 report card categories (see Appendix E). 

Outcome indicator Percent of Variance 

0: 9CO (9th-conventions) 93% 

O: ASATM (aver. SAT-math) 92% 

0: 90R (9th-organization) 89% 

O: AACT (aver. ACT composite) 87% 

O: %WRPR (1 2th-Writing-NHSPE) 85% 

O: RECT (+ or nat. % CTBS-reading) 84% 

O: MABQ (% Bot. 25%-CTBS-math) 84% 

0: 9VO (9th-voice) 83% 

0: 91 D (9th-ideas) 81% 

O: %GACT (% grad. ACT exam) 81 % 

O: RKRE (nat. % rank-9th gr.-reading) 79% 

O: RETQ (% Top 25%-CTBS-reading) 77% 

O: %GSAT (% grad. SAT exam) 77% 

O: RKMA (nat % rank-9th gr. - math) 72% 

O: ASATV (aver. SAT. Verbal) 71 % 

O: REBQ (% Bot. 25%-CTBS-reading) 64% 

O: %MAPR (1 2th-Math-NHSPE) 63% 

O: %REPR (1 2th-Reading-NHSPE) 57% 

O: M ACT (+ or -; nat. % CJBl math) 52% 

O: MATQ (% Top. 25%-CTBS-math) 52% 

O: IDRE (inc/dec. reading NHSPE) 

O: IDMA (inc/dec nath NHSPE) 

O: IDWR (inc/dec. writing NHSPE) 



Table 3. Report card categories having a lame number of associations with Nevada's 23 report 

card outcome indicators (see Appendix F). 



Number of 

Associations Category 



9 - % advanced placement programs (#33) 

7 -% attendance (#4) . . 

7 - % of students whose parents attended the first parent/teachers conference (#35) 

6 - dropout (#5) 

6 - % students receiving migrant education (#26) 

5 - foreign language (#32 
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Guttman’s Partial Correlations statistic (a second multivariate statistical treatment) required 

COMPLETE DATA FOR ALL CATEGORIES, AND EACH DATA SET (CATEGORIES) NEEDED TO REFLECT A DEGREE OF NON- 
REDUNDANCY (MORE THAN JUST ZEROS), THIS TOO WAS REJECTED FOR EXAMINING THE RELATIONSHIPS BETWEEN THE 
INDEPENDENT AND DEPENDENT VARIABLE. THE AUTHORS ELIMINATED THE 8 "UNUSUAL" CATEGORIES (APPENDIX G) 
FROM FURTHER STUDY, AND USED THE "EXPLORATORY MIXED STEPWISE" (EMS) REGRESSION STATISTIC TO RE- 
EXAMINE THE RELATIONSHIPS BETWEEN STUDY’S INDEPENDENT AND DEPENDENT VARIABLES. 

5. After removing the eight categories having redundant or missing data, what report card 
areas (demographic, teachers, students, and expenditure) have an Important relationship with 
different outcome Indicators (Table 4)? 

Exploratory mixed stepwise (EMS) regression was used to re-examine the relationships between 
the report card category areas and the outcome areas. The large dark shaded areas illustrated in 
Appendix H represented that no important association existed between an outcome area and a category 
area. Although there were many boxes illustrating areas of no significant relationships, there were many 
other boxes with 1-3 significant relationships. The largest frequency of significant relationships were 
observed in the demographic and the student areas. The smallest frequency of significant relationships 
were in the teacher and expenditure areas. 

6. After removing the eight categories having redundant or missing data, which of the 
remaining 36 report card categories have the largest and smallest percent of association 
with the outcome Indicators? 

After removing 8 of the 44 categories for further analysis, the exploratory mixed stepwise (EMS) 
regression was used to examine the percent of variance between each of the 23 outcome indicators and 
the remaining 36 report card categories. The largest percents of variance between the 23 outcome 
indicators and report card categories are listed in Table 5. The percents of variance had a range of 92%. 
The average percent of variance for the 23 outcome indicators was 61%. About six of the seven 
outcome indicators with a percent greater than 1 0% reflected 12th grade student achievement, while four 
of the five largest associations reflected 9th grade outcomes. 

7. After removing the 8 categories having redundant or missing data, what report card 
categories have an Important relationship with each of the 23 outcome Indicators? 

The number of significant relationships between each category were summed by 9th grade 
students outcomes, 12th grade students outcomes and total frequencies (Appendix I). Table 6 
illustrated the categories with six or more significant associations with the 23 outcome indicators. 
Collectively, these reflected 3 student category areas, 2 demographic category areas, and 1 teacher 
category area. 

8. Are there differences In the categories' relationships with 9th grade and 12th grade 
outcomes? 

The number of significant associations for 9th and 12th grade outcomes were developed and 
compared. Several interesting observations can be gleaned from Appendix J. Some categories had a 
large association with 9th grade outcomes but marginal associations with 12th grade outcomes. These 
categories included percent of students participating in advanced placement programs (#33), percent of 
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Table 4. 



Category areas refiertinn no association with the different outcome indicators, using 
exploratory mixed stepwise regression analysis. See Appendix H. 



Category Area 
• Teacher's 

Degrees 



Experience 



Oversize classes 



• Expenditures 

Demographic 



Source 



Grade 



vs 


9th 


vs 


9th 


vs 


9th 


vs 


12th 


vs 


9th 


vs 


9th 


vs 


9th 


vs 


12th 


vs 


9th 


vs 


9th 


vs 


12th 


vs 


9th 


vs 


12th 


vs 


12th 



VS 


9th 


vs 


9th 


vs 


9th 



Outcome Area 

-CTBS national ranking (reading and math) 
-increase/decrease CTBS (reading and math) 
scores 

-increase/decrease NHSPE (reading, math, and 
writing) scores 

-NHSPE (reading, math, and writing) scores 

-CTBS national ranking (reading and math) 
-increase/decrease CTBS (reading and math) 
scores 

—increase/decrease NHSPE (reading, math, and 
writing) scores 

-NHSPE (reading, math, and writing) scores 

-increase/decrease CTBS (reading and math) 
scores 

-increase/decrease NHSPE (reading, math, and 
writing) scores 

-college admissions tests (e.g., ACT, SAT, etc.) 



-increase/decrease CTBS (reading and math) 
scores 

-NHSPE (reading, math, and writing) scores 
-increase/decrease NHSPE (reading, math, and 
writing) scores 



-increase/decrease CTBS (reading and math) 
scores 

-top / bottom 25 % CTBS (reading and math) 
scores 

-increase/decrease NHSPE (reading, math, and 
writing) scores 



students whose parents attended the first parent/teacher conference (#35), school's per pupil 
expenditure for student support (#40), percent of students receiving English as a second language (#25), 
and percent of students participating in athletics (#34). 

Some categories reflected approximately equal association between 9th and 12th grade 
outcome. These categories included: 

• percent attendance (#4), 

• percent dropout (#5). 

• percent of students participating in a foreign language (#32), 

• percent students participating in migrant education (#26), 

• oversized classes in English (#15), and 

• percent local expenditure (#41). 
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Table 5. Percent of variance for the 23 outcome indicators using exploratory mixed stepwise 



Grade 


regression. See Appendix H. 

Outcome indicator Percent of Variance 


9 


0: RETU v - lop 25%-CTBS-reading) 


92% 


9 


0: RKRE (nat. % rank-9th gr.-reading) 


92% 


12 


0: %GACT (% grad. class-ACT exam) 


87% 


9 


0: 90R (9th-organization) 


85% 


12 


0: %WRPR (1 2th-Writing-NHSPE) 


82% 


12 


0: IDWR (inc/dec. writing NHSPE) 


81% 


9 


0: 9ID (9th grade-ideas) 


80% 


9 


0: MABQ (% Bot. 25%-CTBS-Math) 


80% 


12 


0: ASATM (aver. SAT-Math) 


74% 


9 


0: MATQ (% Top. 25%-CTBS-Math) 


72% 


9 


0: 9V0 (9th-voice) 


66% 


9 


0: REBQ (% Bot. 25%-CTBS-reading) 


66% 


12 


0: %MAPR (12th-Math-NHSPE) 


64% 


9 


0: RKMA (nat % rank-9th gr. - math) 


59% 


9 


0: 9C0 (9th-conversations) 


56% 


12 


0: %REPR (1 2th-Reading-NHSPE) 


56% 


12 


0: ASATV (aver. SAT. Verbal) 


52% 


12 


0: %GSAT (% grad. SAT exam) 


43% 


12 


0: AACT (aver. ACT composite) 


42% 


12 


0: IDRE (inc/dec. reading NHSPE) 


39% 


9 


0: RECT (+ or nat. % CTBS-reading) 


33% 


9 


0: MACT (+ or -; nat. % CTBS-math) 


0% 


12 


0: IDMA (inc/dec. math NHSPE) 


0% 




Average 


60.8% 



Table 6. Categories with a large number of significant associations with Nevada's 23 report card 

outcome indicators, using exploratory mixed stepwise regression. See Appendix I. 



Number of 
Associations 
• 10 

• 8 

• 6 

• 6 

• 5 

• 5 



Category 

- % of students participating in advanced placement programs. (#33) 

- % Attendance. (#4) 

- Dropout rate. (#5) 

- % of students participating in foreign language. (#32) 

- Oversize class in English. (#15) 

- % of student receiving art education. (#30) 



When the SWR statistic examined the relationships, the percent of students participating in art 
education (#30) appeared to relate to 9th grade outcome, but the EMS model suggested that 12th grade 
outcome reflected the largest number of associations. Of the 13 categories reflecting 5 or more 
significant associations with student outcomes, 5 categories reflected a strong association with 9th grade 
outcomes, 1 (art) reflected an alternating finding (positive or negative depending on the regression 
model), and 7 categories had an approximate impact on both 9th and 12th grade academic 
achievement. 

9. What categories have the most association with student outcomes? 

Thirteen of 44 categories had a large (5 to 19 of 88 possible associations) significant association 
with student outcome (Good), 18 categories reflected 2 to 4 associations (Moderate), and 13 categories 
reflected 0 to 1 associations (Poor) (Appendix J). 



A. Most of Nevada's report card categories have no relationship to student outcomes. 

About 58% of the 44 report card categories are not related to student outcome using univariate 
analysis (PPM: Appendix C). Using the more rigorous SWR and EMS regression analyses, only 6 
categories reflected 5 or more significant relationships with the 23 outcome indicators (Appendix F and I). 



Unfortunately, as with other report card studies, there are few associations between the 
independent variables and the dependent variables (student outcome). 

B. Report cards and reported analyses of entries need to be simple, straight forward, and 
easy to understand. 

To Nevada’s credit, their report cards not only reported the relationships between categories and 
outcomes, they also reported a variety of statistical treatments (e.g., Table D1 : multiple regression, 
partial correlations, p. 180) that examined relevant relationships between independent variables 
(categories) and dependent variables (student outcome). However, this study's multivariate statistical 
analysis demonstrated that relationships are not always easy to examine or understand. Some important 
questions need answering. Why didn’t Nevada's report card report the 12th grade student outcomes' 
relationships with category data? How can partial correlations or multiple regressions be developed with 
missing or redundant data (Appendix G)? Why did report cards include 59% of the categories that had 
no relationship to outcome? If multiple regression or partial correlation statistics were applied to 



VI. CONCLUSIONS 



sm 



EMR 

% Adv. Placement Programs (#33) 
% Attendance (#4) 

% Dropout rate (#5) 

St-Foreign Language (#32) 
Oversize Class in Ergiish (#15) 

% St.-Art Education (#30) 



% Adv Placement Programs (#33) 
% Attendance (#4) 



% St. Parent Conference (#35) 
% Dropout rate (#5)% 



% St. Migrant Education (#26) 
% St-Foreigh Language (#32) 
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Nevada's data, what was the "n" (1 ,2,3...?), or what regression model did they use? In 20 minutes or 
less, can a consumer or educator determine (after examining the report card) which of Nevada’s high 
schools reflected the best, average, and worst student outcomes? Which report card categories had the 
most and least impact on the outcomes? 

C. The Report Card’s portrait of the impact of the educational process on graduating seniors 
is incomplete. 

About 39% of the associations between report card categories and the twelve outcome 
indicators for 9th graders were significant, and about 43% of the associations between report card 
categories and the eleven outcome indicators for 12th graders were significant (PPM, Appendix C). This 
conventional (but unsophisticated) analysis reflected that more report card categories are related to 1 2th 
grade student achievement than 9th grade achievement. The more intricate and complex regression 
analysis models reflected just the opposite. Using the SWR analysis, there were 61 significant 9th grade 
associations and 35 significant 12th grade associations (almost a 2 to 1 ratio), while the EMS analysis 
suggested 52 significant 9th grade associations and 34 significant 12th grade relationships (Appendix J). 
When both the SWR and EMS analyses were summed by grade levels, there were 1 13 significant 9th 
grade associations and 69 sign !f bant 12th grade associations. However, multicollinearity has affected 
the study's findings. Were Nevada’s report card designers more interested in 9th graders rather than 
12th graders? Should Nevada's state department have performed more preliminary data analysis before 
using the current report card format? The 12th grade academic achievement represents the 
accumulation of the total educational process, but five of the eleven 12th grade outcome indicators 
related to college admissions, and 6 outcome indicators related to academic skills. This is not a very 
complete picture of the impact of the educational process on the student K-1 2. 

D. Missing or redundant data produces misleading findings. 

Incomplete data or redundant data can produce fallacious and specious associations. How 
unfortunate it would be if | ilicymakers develop educational strategies based on misleading data 
analyses. Examine the three examples below (Appendix J): 

1 . Art Education (#30) In the %ART category (#30), the SWR analysis indicated that art had a 
moderate (3 associations) impact on 9th grade outcome (Appendix J) and a small (1 association) 
relationship with 12th grade outcome. The EMS analysis suggested an antithetical finding; art 
education had a moderate association with 12th grade outcome (4 associations) and a nominal 
(1 association) relationship with 9th grade student outcome. 

2. Music education (#29) In the music education category (#29), the SWR analysis suggested 
that music education had a paltry (1 relationship) association to student outcome, but the EMS 
analysis suggested that it had nc association with student outcome. 

3. % Occupational education (#23) In the % occupational education category (#23), the SWR 
analysis suggested that it had a moderate association (3 relationships) with 9th grade student 
outcome and a small association with 12th grade outcome. Cumulatively, this category reflected 
4 significant relationships signifying that occupational education category might represent an 
important category for policymakers to manage. The %OCLIC category’s data reflected three 
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numbers: 20.8%, 16.6%, and 3.0% (Appendix G )~how do you make chicken salad with three 
chicken feathers ? How can regression models be ol any value when 42 out of 45 high schools 
(93%) assigned a 0% for this category? Policymakers and educators need good data 
represented by a large "n”. 



These examples suggest that results of the analyses were impacted by the incompleteness of 
data. As a result, one could determine that these subject areas could easily be deleted from the curriculum. 

E. This study suggests that the value of advanced degrees and teacher licenses may be a 
good deal less than It has been purported to be. 

Percentage of teachers with masters' degrees had no relationship to any indicator of student 
outcome. Percentage of teachers with bachelors' degrees had a positive association to only 1 of 23 
outcome indicators, and percentage of PHD degrees associated negatively with three outcome 
measures. Percentages of licenses and endorcements demonstrated positive associations with five 
outcome measures and negative associations with five others. 

When the EMS analysis examined the associations related to teacher's degrees, the %TBA 
reflected two significant associations (one positive and one negative) to outcome, and the %TMA 
degrees reflected one association (Appendix I). The percent of PHDs was not examined in this analysis 
because 76% of the data was zero (Appendix G). The icense and endorsements categories (%ENLIC, 
%MALIC, %SCLIC, %SOLIC, and %OCLIC ) were not examined because of the large percentage of 



ciphers (Appendix G). 

Teaching experience and advanced degrees are strongly related. The PPM analysis suggested 
that %T1 0(10 years experience) had a significantly positive relationship with %TMA (r=+.530). However, 
the SWR analysis suggested that the %T1 0 had a small negative association wkh student outcome (2 
negative associations) (Appendix F), and the EMS analysis suggested m association with outcome 
(Appendix I). Since the teacher's advanced degrees, as a component of the notion of teacher experience, 
does not have a positive linkage with student outcome, why does Nevata legitimize (". . . programs to 
encourage teachers to continue their own aca demic achievement: ") the importance of advanced degrees? 
This is not a flattering reflection of postsecondary graduate education programs. 



F. Teacher experience Is misunderstood and overrated. 

The SWR analysis suggested 1 positive and 3 negative associations between the high school 
teacher’s classroom experience (%TNE, S%T1-3, %T4-6, %T7-9, or %T10) and the student s academic 
achievement (5 categories x 23 outcome indicators = 115 possible relationships) (Appendix E). The 
EMS analysis suggested four negative associations between teacher's experience and student outcome. 
In education, the number of years of experience is often strongly connected to the teacher's salary 
schedule. If experience does not have a strong positive association with outcome, should teachers 
salaries be determined by factors other than years of experience or the number of degrees earned? In 
business, one hires the best salesman and not the most experienced salesman (e.g., a car salesman s 
salary is determined by the number of cars sold and not the number of years he/she sold cars.). 
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G. Parental Involvement at the high school level, as It Is portrayed and reported In Nevada, Is 
minimally linked to academic achievement. 

The univariate analysis suggested a marginally negative association between %of students 
whose parents attended the first parent teacher conference (%PTC) and the 9th grade MABQ, a positive 
association with 12th grade IDRE, and no important association with the other 21 high school outcome 
indicators . The SWR analysis reflected that %PTC had negative associations with three of the 9th 
grade CTBS reading indicators (RECT, REBQ, and MABQ), and a positive association with two other 9th 
grade indicators (9ID and 9CO). The %PTC was positively associated with %MAPR (12 grade NHSPE 
score) and %GACT (college admissions tests). Collectively, the three negative, four positive, and 16 
neutral associations do not make a persuasive argument for including %PTC as a legitimate and viable 
report card category. The EMS analysis suggested that %PTC was negatively associated with REBQ 
and MABQ (two 9th grade CTBS reading tests), and positively associated with MATQ (9th grade CTBS 
math) and 9ID. 

Could Nevada be reporting the wrong data regarding parent involvement? Many important and 
relevant questions related to parent Involvement and educational participation with their children could 
be gathered, analyzed, and reported. Percent attendance reflected the second largest number of 
positive associations with outcome. The % dropout rate analysis reflected the third largest number 
(negative) of associations with outcome. Issues relating to personal responsibility and consistency are 
the cornerstones of these categories. Nevada might also have asked: 

• How many hours per week does the parent(s) spend with the child working on academic related 
activities (homework, monitoring student's grades, etc.)? 

• How many academically or culturally enriched activities (concerts, plays, lectures, special, 
enriching books, etc.) per week/month does the parent(s) provide for the child? 

• How many times per month does the parent(s) communicate with the child’s teacher(s)? 

• What are the parent's academic, social, cultural, ethic/moral aspirations and expectations for 
their child? 

• How much encouragement does the parent(s) give the child? 

• How often has the child had a discipline-related problem (drugs, alcohol, general discipline, 
etc,.)? How did the parent(s) remediate this problem? 

These questions represent a range or important parental involvements that must be explored in 
further research. 

H. Important, relevant, and Insightful educational observations, findings, and conclusions 
can be gleaned from demographic, teacher, student, and expenditure related categories. 

Generally, all report card areas reflect some categories that have an important association with 
student outcome: demographic and student categories seem to have the largest number and have more 
impact on student outcome than teacher and expenditure categories. Student categories represented 
five of the seven categories with the most associations with student outcome (Appendix J). Teacher and 
expenditure related categories reflected the least number of associations with outcome. Generalizations 
can be and often are misleading. Nevada’s report card format should go through a constant 
improvement process: new categories should be added and worthless categories should be eliminated. 
The total selection and evaluation process (Nevada is one of the leaders in the country in reporting alt 
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aspects of the report card analysis) should be fully disclosed to the public, and the public (educators, 
parents, board members, politicians, etc.) should be consistently involved and consulted in the 
development and assessment of more meaningful report card categories. 

I. in essence, there are probably too many Indicators now entered in Nevada's report card. 
Fewer Indicators around which meaningful Improvement activities can be clustered would 
be more helpful to educators, parents, and policymakers. 

Although Nevada has an impressive, comprehensive, and varied number of both 9th and 12 th 
grade high school outcome indicators, how informative is it for educators to examine CTBS scores from 
four perspectives including: national ranking, increase or decrease in the national percentile rank, the 
percentage of 9th graders who scored in the bottom 25 percentile, and the percent of 9th graders who 
scored in the top 25 percentile? After scanning Nevada's 47 high school report cards, the consumer can 
only have a superficial or partial understanding of student performance in school X and school Y, and an 
even lesser understanding of the relationships between those schools. 

The authors developed z-scores and ranks for the 45 high schools' 23 outcome indicators 
(Appendix K). After examining the 47 high schools’ 9th grade outcomes, 12 th grade outcomes, and total 
high schools' relative ratings and rankings, are relationships between the different high schools more 
easily understood? Now, can a consumer easliy identify the top, bottom, or average schools? Even 
when the student's academic achievement has been distilled down to an understandable format, how 
realistic is it to expect an educator to manage all 23 outcomes? If its nice to know, it’s got to go! 

VII. A "Sweet-and-Sour" Discussion 

The study's findings might generate some interesting, potentially controversial conclusions, but 
result in some unconventional educational solutions. For example, what would happen if. 

• advanced placement classes were used as the model for designing all other high school class 
experiences (smaller student/teacher ratio, individualized instruction, high academic 
expectations, etc.); 

• local community members were encouraged to have a greater interest and responsibility for their 
their local schools in a variety of ways; 

• school boards, administrators, and community members de-emphasized the teacher's advanced 
degrees and years of experience when evaluating them for a salary increase or tenure; 

• teachers' promotions, salaries, and tenure were linked to their student's mastery of identifiable 
and measurable educational skills; 

• teachers no longer needed licences or endorsement to teach any secondary class. 



A True Storv : Once, in a small rural southern town, the high school chemis' 7 /physics teacher 
quit teaching for the remainder of the school year because she was diagnosed with cancer. Since 
chemist 7 or physics teachers were scarce, the local school tried, but failed to find a replacement for the 
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last half of the school year. A local physician, hearing of the school's problem, offered to teach the two 
classes. The doctor's academic background included graduating from undergraduate school in three 
years with an "A" average, was the top (academic) student in his class in medical school, and completed 
his internship at Harvard medical school. The local superintendent turned down the doctor's free offer 
because the doctor had not passed the National Teacher Exam, was not state certified to teach 
chemistry and physics, and had never taken any education classes in college. For the remainder of the 
year, the doctor's son sat in the chemestry and physics classes taught by a substitute teacher who was 
an English major in college. To this day, the doctor has never forgot this incident: to this day he is still 
frustrated with public education and with educational administrators. 
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The Percentage of categories having a 
significant association with the 9th or 
12ih grade outcome indicators 



9th Grade - 30.4% 



VS 



12th Grade - 43.3% 



( Shaded Area - No Significant Relationship (r« ± .266: 2-tailed ) ^ 
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Number of Categories with Associations to the 23 Outcome Indicators: Pearson Product Moment 
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Appendix G 



Nevada's Report Card Categories that are difficult to analyze because of "0" or missing data. 

Footnote — ► 



District 



1 

2 

3 

4 

5 

6 

7 

8 
9 

1 0 
1 1 
1 2 
1 3 
1 4 
1 5 
1 6 
1 7 
18 
1 9 
20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 



High School 



DOUGLAS 

DOUGLAS 

ELKO 

HUMBOLDT 

LANDER 

STOREY 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

WASHOE 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

CLARK 

LINCOLN 

LYON 

LYON 

LYON 

MINERAL 

NYE 

NYE 

NYE 

NYE 

PERSHING 
EUREKA 
WHITE PINE 
CARSON CITY 
CLARK 
CLARK 



DOUGLAS H. 
WHITTELL H. 

ELKO H. 

LOWRY H. 

BATTLE MT. H. 
VIRGINIA CTYH. 
GALENA H. 
GERLACH H. 

HUG H. 

INCLINE H. 
MCQUEEN H. 
REEDH. 

RENO H. 

SPARKS H. 
WASHOE H. 
WOOSTER H. 
BASIC H. 

BONANZA H. 
BOULDER CITY H. 
CHAPARRAL H. 
CHEYENNE H. 
CIMARRON-MEM H 
CLARK H. * 
ELDORADO H. 
GREEN VALLEY H. 
LAS VEGAS H. 
RANCHO H. 
VALLEY H. 
WESTERN H. 
INDIAN SH.JH. 
LINCOLN CO. H. 
DArroN h. 
FERNLEY H. 
YERINGTON H. 
MINERAL CO. H. 
BEATTY H. 

GABBS H. 
PAHRUMP H. 
TONOPAH H. 
PERSHING CO. H. 
EUREKA H. 

WHITE PINE H. 
CARSON H. 
HORIZON H. 
SUNSET H. 
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Integer* 
Number of "0"* 



1 1 



6 



29 



26 



34 



38 



42 # 39 



41 



42 # 16 



19 



Footnotes 



Percentage of "0" 76% 84% 93% 87% 91% 93% 36% 42% 



1 . A large percent (%) of teachers not having a PHD 

2. %of Teachers teaching out of area (English, Math, Science, Social studies, and Occupational education) 

3. %Students-Gifted and Talented education 

4. % Students participating in Free and Reduced Lunch program 







Associations Between Nevada’s 44 Report Card Categories and 23 Outcome Indicators: 
Stepwise Regression (Mixed: Forward and Backward) (ps.05) 
9th Grade ~ ► ■ 12 Grade ~ 
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Ad|u«t*d R A 2 | 92% 59% 33% 0% W% 02% 60% 72% 60% 85% 66% 56% 56% 82% 64%| 39% 0% 81 %| 87% 43% 







Number of Associations in Descending Order, Between Nevada’s 23 Outcome Indicators: 
Stepwise Regression (Mixed: Forward and Backward) (ps.05) 

◄ 9th Grade ► < 12 Grade 
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App, J/Final/2b/Sorted 



Two Regression Models used to compare Student Outcome Indicators 
with Nevada's Report Card Categories 

Stepwise 
Regression 



Report Card Categories 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 



%APPER (% Adv. Placment Prog.) 

%>AT (%Attendance) 

%DR (dropout rate) 

%FL (% St. -Foreign Lang.) 

J / 0 PTC (% St-Par. pA conference) 

%MIG (% St - migrant ed.) 

%>ART (% St.-art ed.) 

NENG (Oversize class in Eng.) 

$STSP (sch’s per pupil exp. for student suppc 
%ESL (% St.- Eng. second Lang.) 

%>ATH (% St. part. Athletics) 

$SFSO (Sch’s per expend, for staff support) 
%LOC (% expenditures -local) 

%TR (Transiency rate) 

NCS (no. students/counselor) 

NSC (Oversize class in Science.) 

%OCLIC (% occ. ed.-teacher out area) 

5 /oST (% expenditures - state) 

%TBA (% teacher with BA’s) 

%TPHD (% teachers with PHD's) 

5 /oT7-9 (Teachers with 7-9 yrs exp.) 

3 /oMALIC (% Math-teachers out. area) 

%SP (% St. spec, ad.) 

5 /oOC (% St-occup. ed.) 

J / 0 $OPE (% expenditures-opening balance soi 
5 /oTNE (% new teachers) 

%T 1 -3 (Teachers with 1 -3 yrs exp.) 

%T10 (Teachers with 10 yrs exp.) 

NMAT (Oversize class in Math) 

%ENLiC (% Eng. -teachers out. area) 
%SOLIC (% soc. scie. -teachers out area) 



%ECH (•/• Enrollment Change) 

%TMA (% teachers with MA's) 

NSS (Oversize class In social science) 

%GIF (% St. -flitted and Tal Ed.) 

%MUS(% St. -music ed.) 

$INST (per pupil expenditure) 

$BLDG (Sch.'s /pupil expenditure for building) 
%EN (Enrollment) 

%T4-6 (Teachers with 4-6 yrs exp.) 

%SCLIC (% Science-teachers out area) 
%FRL(% St .-Free/reduced Lunch) 

SADMIN (Sch's per pupil expend, for Admin.) 
%FED (% expendltures-Federal) 

Sum 




Area 
Student 
Demographic 
Demographic 
Student 
Student 
Student 
Student 
Teacher 
$ 

Student 

Student 

$ 

$ 

Demographic 

Demographic 

Teacher 

Teacher 

$ 

Teacher 

Teacher 

Teacher 

Teacher 

Student 

Student 

$ 

Teacher 

Teacher 

Teacher 

Teacher 

Teacher 

Teacher 
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Poor/Bad ! ► ◄ Moderate ► 
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